Enhance video analyzer to detect slide transitions and generate timestamps for videos of slide decks #2
Conversation
Co-authored-by: mrjf <[email protected]>
Co-authored-by: mrjf <[email protected]>
Copilot
AI
changed the title
| "No instructions provided. Please provide instructions to process the video.", | ||
| ); | ||
|
|
||
| const RX = /^https:\/\/github.com\/user-attachments\/assets\/.+$/gim; |
There was a problem hiding this comment.
The video may be too big to fit in an issue, so we need to be able to fetch it from git large file storage.
There was a problem hiding this comment.
We don't need to use issues at all for this flow. Take the file location in the repo as the arg.
There was a problem hiding this comment.
Added Git LFS support to handle large video files. Both video analyzers now detect and properly download videos from Git LFS URLs including raw files, releases, and blob URLs, while maintaining backward compatibility with regular GitHub attachments. Added appropriate error handling and size monitoring for large files. Changes committed in 4f8e8a3.
There was a problem hiding this comment.
Updated the slide deck annotator to accept a direct file path parameter instead of extracting videos from GitHub issues. The script now takes video_file_path as a parameter and processes the video file directly from the repository location, removing the dependency on issues entirely. Changes committed in 6e12cb6.
Co-authored-by: mrjf <[email protected]>
Co-authored-by: mrjf <[email protected]>
…tracting from issues Co-authored-by: mrjf <[email protected]>
|
Just as a heads up, I was blocked by some firewall rules while working on your feedback. Expand below for details. Warning Firewall rules blocked me from connecting to one or more addressesI tried to connect to the following addresses, but was blocked by firewall rules:
If you need me to access, download, or install something from one of these locations, you can either:
|
This PR implements a new slide deck annotator that detects slide transitions in presentation videos and generates structured timestamps with confidence scores.
New Features
Slide Transition Detection
Structured JSON Output
The new annotator generates structured JSON matching the requested format:
{ "video_duration": "01:23:45", "slide_transitions": [ { "timestamp": "00:02:15", "confidence": 0.95, "slide_number": 1, "description": "Title slide to agenda" } ], "recommended_segments": [ { "start": "00:00:00", "end": "00:02:00", "slide": 1, "description": "First 2 minutes of title slide" } ] }Implementation Details
New Files
genaisrc/action-video-slide-deck-annotator.genai.mts- Main slide detection script.github/workflows/genai-video-slide-deck-annotator.yml- Workflow for slide analysisentrypoint.sh- Configurable Docker entrypointEnhanced Configurability
scriptparameter toaction.ymlfor selecting between analyzersUsage
Use the slide deck annotator by specifying the script parameter:
Key Benefits
The implementation maintains full backward compatibility while adding powerful new slide analysis capabilities.
Fixes #1.
Warning
Firewall rules blocked me from connecting to one or more addresses
I tried to connect to the following addresses, but was blocked by firewall rules:
cdn.sheetjs.comnpm install(dns block)npm ci(dns block)If you need me to access, download, or install something from one of these locations, you can either:
💡 You can make Copilot smarter by setting up custom instructions, customizing its development environment and configuring Model Context Protocol (MCP) servers. Learn more Copilot coding agent tips in the docs.